REPLACEMENT SHEET 



601 



602 TV STATION 



TELEVISION 
PROGRAM 



605 



CM | 

603 



- J CUE SHEET 



BROADCAST 
PROGRAM 



604 

- H CUE DATA 




BROADCAST 

SYSTEM 607 



606 



615 



SERVICE PROVIDER 
> j CUE DATA f \ j 607 



AUTHORING 
TOOL 



616 



WEB 
CONTENTS 
INFORMA- 
TION, CM> 



CONTENTS \\j 618 



BROADCAST 



INTERNET 



608 



RECEIVING EQUIPMENT 
(ANTENNA) 



609 



610 



DOMESTIC SITE 
619 



RECEIVING DEVICE 
(MODEM)' """ 



TV SET 



TUNER 



BROADCAST 
PROGRAM 



IMAGE 
CIRCUIT 



CATHODE-RAY 
TUBE 



612 



613 



614 



620 



623 



PC 



CLIENT SOFTWARE 



£1 



621 



BROWSER 



INTERNAL 
CLOCK 



CONTENTS K~N C ~ r „ 
1 ^- « v — 622 



624 



61 8 



DISPLAY 



IMAGE 
CIRCUIT 



CATHODE-RAY 
TUBE 



625 



626 



FIG. 



PRIOR ART 



REPLACEMENT SHEET 



100 



IMAGE SOURCE 



I 



103 



120 IMAGE 
SUPPLYING UNIT 



AUTHORING 
SYSTEM 

101 



IMAGE MARKING 
INSERT 



MARK-INSERTED 
IMAGE SOURCE 



REGISTER FEATURE RLE 
FOR MOVING PICTURE 



MATCHING 



BROAD- 
CAST 
* 



FEATURE RLE 
LIBRARY 



IT\ 102 



104 



113 
AREA OF 
USER'S PC 



INTER- 
NET 




PACKAGE 



EDITING 
UNIT 



^1 



105 



IMAGE CLI 



i 



IMAGE MARKING 
IDENTIFYING UNIT 




IMAGE CONTENTS 



MOVING PICTURE 
MATCHING TIME AXIS 
DETECTING UNIT 



i 



109 



110 



WEB CONTENTS 
(HTML CONTENTS) 



111 



112 




s 

108 



VIEWER SYSTEM 



FIG. 2 



REPLACEMENT SHEET 



100 



IMAGE SOURCE 



101 



AUTHORING SYSTEM 

200 201 



FEATURE FILE 
PRODUCING UNIT 




IMAGE MARKING 
INSERTING UNIT 












f 






FEATURE FILE 
LIBRARY 




MARK-INSERTED 
IMAGE SOURCE 



102 



103 



FIG. 3 




REPLACEMENT SHEET 



300 



301 



302 



MARK-INSERTED 
IMAGE SOURCE 




MARK-INSERTED 
IMAGE SOURCE 



303 



BROADCAST 




MARK-INSERTED 
IMAGE SOURCE 



304 



INTERNET 



305 



PACKAGE 
MEDIUM 



104 



EDITING 
UNIT 



MARK-INSERTED 
IMAGE SOURCE 



MARK-INSERTED 
IMAGE SOURCE 



MARK-INSERTED 
IMAGE SOURCE 



/ 105 \ / 106 \ / 107 X 



IMAGE CLIP (1) IMAGE CUP (2) 



1 | IMAGE CLIP (3) ) 



:><- 



• — | IMAGE CLIP (3) | IMAGE CLIP (1) | IMAGE CLIP (2) | — 
EDITED AND INTEGRATED IMAGE CONTENTS 



108 

rJ 



FIG. 4 



REPLACEMENT SHEET 



IMAGE CLIP (3) 
(PACKAGE 
MEDIUM) 



IMAGE CUP (2) 
(INTERNET) 



IMAGE CUP(1) 
(BROADCAST) 



700 



701 



702 



INFORMATION 
DETECTION 



INFORMATION 
DETECTION 



INFORMATION 
DETECTION 



704 






VIEWER SYSTEM 

« 



INTERNET 



INTERNET 



703 



f 




FEATURE FILE LIBRARY 




!( 




FEATURE RLE + 
SYNCHRONIZING 
INFORMATION SCRIPT (3) 


















FEATURE RLE + 
SYNCHRONIZING 
INFORMATION SCRIPT (2) 








-► 










FEATURE FILE + 
SYNCHRONIZING 
INFORMATION SCRIPT (1) 























WEB CONTENTS 
(HTML CONTENTS) 



705 











IMAGE DISPLAY 




WEB CONTENTS 
DISPLAY 




DISPLAY OF VIEWER SYSTEM 



706 



FIG. 5 



REPLACEMENT SHEET 



( START ) 



PRODUCE FEATURE FILE FOR MOVING PICTURE 
MATCHING BASED ON AN IMAGE SOURCE, AND STORE fVy S1 
THE FEATURE FILE INTO A FEATURE FILE LIBRARY 



I 



INSERT AN IMAGE MARKING REPRESENTING A _ 
LOCATION WHERE THE FEATURE FILE IS STORED, P^/ ^ 
INTO THE IMAGE SOURCE 



I 



MARK INSERTED IMAGE SOURCE IS SUPPLIED TO 

USER IN A FORM OF BROADCASTING DATA. 
DATA PROVIDED FROM THE INTERNET, OR DATA 
STORED IN A PACKAGE MEDIUM 



S3 



EDIT THE RECEIVED IMAGE SOURCE BY THE USER 



DETECT A URL OF THE FEATURE RLE LIBRARY FROM 
THE IMAGE MARKING. AND ACCESS THE LIBRARY 

I 



S4 



S5 



SEARCH AND RETRIEVE THE FEATURE FILE AND 
SYNCHRONIZING INFORMATION SCRIPT WHICH 
CORRESPOND TO EDITED IMAGE FROM THE 
LIBRARY BY USING A FEATURE RLE ID 



EXTRACT A SYNCHRONIZING TIME AND 
SYNCHRONIZING CONTENTS INFORMATION FROM THE 
RETRIEVED FEATURE RLE AND THE RETRIEVED SCRIPT 



^7 



S7 



WHEN THE EDITED IMAGE CONTENTS ARE 
REPRODUCED, DISPLAY WEB CONTENTS WITH 
LINKING THE EDITED IMAGE CONTENTS BASED 
ON A SYNCHRONIZING TIMING 



S8 



( END ) 



FIG. 6 



REPLACEMENT SHEET 



JUH 2 1 2005 o. 

J 



IMAGE SOURCE 

i 



AUTHORING 
SYSTEM 




IMAGE MARKING INSERT 
(REGISTRATION OF 
INFORMATION FOR MOVING 
PICTURE MATCHING) 



401 



402 



MARK-INSERTED 
IMAGE SOURCE 



413 IMAGE 
SUPPLYING 
UNIT 



41 1 
AREA OF 
USER'S PC 



403 













/ 
t 


BROAD- 
CAST 


INTER- 
NET 


PACKAGE 
MEDIUM 










r i 









EDITING 
UNIT 



404 



405 



IMAG E CU 
| IMAGE CUPTO 



IMAGE CLIP (3) 



406 



j 



IMAGE MARKING 
IDENTIFYING UNIT 




MOVING PICTURE 
MATCHING TIME AXIS 
DETECTING UNIT 




IMAGE CONTENTS 



i ._ 



WEB CONTENTS 
(HTML CONTENTS) 



7 

410 



41 2 




407 



VIEWER SYSTEM 



FIG. 7 




REPLACEMENT SHEET 



IMAGE SOURCE ^ /~\ 500 



501 



AUTHORING 
SYSTEM 



502 



520 IMAGE 
SUPPLYING 
UNIT 



!r=L 



MARK-INSERTED 
IMAGE S0URCEC1) 



AREA OF 
USER'S PC 



503 



MARK-INSERTED 
IMAGE S0URCE(2) 



BROADCAST 



504 



MARK-INSERTED 
IMAGE SOURCEO) 



INTERNET 



PACKAGE \ 
MEDIUM J 




EDITED AND INTEGRATED IMAGE CONTENTS 



IMAGE MARKING 
IDENTIFYING UNIT 



507 



MOVING PICTURE 
MATCHING TIME AXIS 
DETECTING UNIT 



508 



WEB CONTENTS 
(HTML CONTENTS) 



? 

509 



510 




505 



506 



VIEWER SYSTEM 



FIG. 8 



